y 4MEDIA|JX  test 

0F^10  RADio^VERtISING  \ j h'epfi) 

'R^RMED  SERVICES  RECRUITMENT/  ‘ “ 


PREPARED 


J.  WALTER  THOMPSON 


ON  BEHALF  OF  THE 


OFFICE  OF  ASSISTANT  SECRETARY  OF  DEFENSE 
(MANPOWER  & RESERVE  AFFAIRS)  _ 


DEPARTMENT  OF  DEFENSE 


THE  PENTAGON 


WASHINGTON,  D.C 


CONTRACT  NUMBER 


M0QO27-73-A 


PREPARED  BY 


RUSS  HALEY  ft  ASSOCIATES,  INC 


405  LEXINGTON  AVENUE 


NEW  YORK,  NEW  YORK  10017 


Unclassified 


SECURITY  CLASSIFICATION  OF  THIS  PAGE  (When  Date  Entered) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

t.  REPORT  NUMBER 

No  number  available 

2.  GOVT  ACCESSION  NO. 

3.  RECIPIENT'S  CATALOG  NUMBER 

4.  TITLE  (and  Subtitle) 

A MEDIA  MIX  TEST  OF  PAID  RADIO  ADVERTISING  FOR 
ARMED  SERVICE  RECRUITMENT,  Volumes  One-Four 

5.  TYPE  OF  REPORT  » PERIOD  COVERED 

Research  Report 

6.  PERFORMING  ORG.  REPORT  NUMBER 

number  not  available 

7.  author^; 

Research  Staff  and  Dr.  Raymond  E.  Schucker 

8.  CONTRACT  OR  GRANT  NUMBERS) 

M0OO27  73  A 0013  ^ 

9.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Russ  Haley  & Associates  Inc. 

405  Lexington  Avenue 

New  York,  NY  10017 

10.  PROGRAM  ELEMENT.  PROJECT.  TASK 
AREA  A WORK  UNIT  NUMBERS 

no  number  available 

It.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

OASD(M,RA&L)MPP 

Accession  & Retention  Programs,  Rm  2B269 
Pentagon,  Washington.  D.C.  20301 

12.  report  dat^oI  1&2-May  76 

Vol  3-Jul  76,  Vol  4-Mar  77 

13.  NUMBER  OF  PAGES 

225 

14.  MONITORING  AGENCY  NAME  A ADDRESS(7/  different  from  Controlling  Office) 

Same  as  11 

15.  SECURITY  CLASS,  (of  thla  report) 

Unclass if ied 

1 5a.  DECLASSIFICATION/ DOWNGRADING 
SCHEDULE 

16.  DISTRIBUTION  STATEMENT  (of  thla  Report) 


approved  for  public  release;  unlimited  distribution 


INSTRUCTIONS  FOR  PREPARATION  OF  REPORT  DOCUMENTATION  PAGE 


RESPONSIBILITY.  The  controlling  DoD  office  will  be  responsible  for  completion  of  the  Report  Documentation  Page,  DD  Form  1473,  in 
all  technical  reports  prepared  by  or  for  DoD  organizations. 

CLASSIFICATION.  Since  this  Report  Documentation  Page,  DD  Form  1473,  is  used  in  preparing  announcements,  bibliographies,  and  data 
banks,  it  should  be  unclassified  if  possible.  If  a classification  is  required,  identify  the  classified  items  on  the  page  by  the  appropriate 
symbol. 


COMPLETION  GUIDE 

General.  Make  Blocks  1,  4,  5.  6,  7, 
Blocks  2 and  3 blank. 


11,  13,  15,  and  16  agree  with  the  corresponding  information  on  the  report  cover.  Leave 


Block  1.  Report  Number.  Enter  the  unique  alphanumeric  report  number  shown  on  the  cover. 

Block  2.  Government  Accession  No.  Leave  Blank.  This  space  is  for  use  by  the  Defense  Documentation  Center. 

Block  3.  Recipients  Catalog  Number.  Leave  blank.  This  space  is  for  the  use  of  the  report  recipient  to  assist  in  future 
retrieval  of  the  document. 

Block  4.  Title  and  Subtitle.  Enter  the  title  in  all  capital  letters  exactly  as  it  appears  on  the  publication.  Titles  should  be 
unclassified  whenever  possible.  Write  out  the  English  equivalent  for  Greek  letters  and  mathematical  symbols  in  the  title  ( see 
“ Abstracting  Scientific  and  Technical  Reports  of  Defense-sponsored  RDT/E,**  AD-667  000).  If  the  report  has  a subtitle,  this  subtitle 
should  follow  the  main  title,  be  separated  by  a comma  or  semicolon  if  appropriate,  and  be  initially  capitalized.  If  a publication  has  a 
title  in  a foreign  language,  translate  the  title  into  English  and  follow  the  English  translation  with  the  title  in  the  original  language. 

Make  eve^y  effort  to  simplify  the  title  before  publication. 

Block  5.  Type  of  Report  and  Period  Covered.  Indicate  here  whether  report  is  interim,  final,  etc.,  and,  if  applicable,  inclusive 
dates  of  period  covered,  such  as  the  life  of  a contract  covered  in  a final  contractor  report. 

Block  6.  Performing  Organization  Report  Number.  Only  numbers  other  than  the  official  report  number  shown  in  Block  1,  such 
as  series  numbers  for  in-house  reports  or  a contractor  grantee  number  assigned  by  him,  will  be  placed  in  this  space.  If  no  such  numbers 
are  used,  leave  this  space  blank. 

Block  7.  Authorfs,).  Include  corresponding  information  from  the  report  cover.  Give  the  namefs.)  of  the  authors,)  in  conventional 
order  (for  example,  John  R.  Doe  or,  if  author  prefers,  J . Robert  Doe).  In  addition,  list  the  affiliation  of  an  author  if  it  differs  from  that 
of  the  performing  organization. 

Block  8.  Contract  or  Grant  Numbers).  For  a contractor  or  grantee  report,  enter  the  complete  contract  or  grant  numberfs.)  under 
which  the  work  reported  was  accomplished.  Leave  blank  in  in-house  reports. 

Block  9.  Performing  Organization  Name  and  Address.  For  m-house  reports  enter  the  name  and  address,  including  office  symbol, 
of  the  performing  activity.  For  contractor  or  grantee  reports  enter  the  name  and  address  of  the  contractor  or  grantee  who  prepared  the 
report  and  identify  the  appropriate  corporate  division,  school,  laboratory,  etc.,  of  the  author.  List  city,  state,  and  ZIP  Code. 

Block  10.  Program  Element,  Project,  Task  Area,  and  Work  Unit  Numbers.  Enter  here  the  number  code  from  the  applicable 
Department  of  Defense  form,  such  as  the  DD  Form  1498,  “Research  and  Technology  Work  Unit  Summary’*  or  the  DD  Form  1634. 

“Research  and  Development  Planning  Summary,”  which  identifies  the  program  element,  project,  task  area,  and  work  unit  or  equivalent 
under  which  the  work  was  authorized. 

Block  11.  Controlling  Office  Name  and  Address.  Enter  the  full,  official  name  and  address,  including  office  symbol,  of  the 

controlling  office.  (Equates  to  funding ' sponsoring  agency.  For  definition  see  DoD  Directive  5200.20,  ** Distribution  Statements  on 

Technical  Documents.") 

Block  12.  Report  Date.  Enter  here  the  day,  month,  and  year  or  month  and  year  as  shown  on  the  cover. 

Block  13.  Number  of  Pages.  Enter  the  total  number  of  pages. 

Block  14.  Monitoring  Agency  Name  and  Address  (if  different  from  Controlling  Office).  F or  use  when  the  controlling  or  funding 
office  does  not  directly  administer  a project,  contract,  or  grant,  but  delegates  the  administrative  responsibility  to  another  organization. 

Blocks  15  & 15a.  Security  Classification  of  the  Report:  Declassification/Downgrading  Schedule  of  the  Report.  Enter  in  15 
the  highest  classification  of  the  report.  If  appropriate,  enter  in  15a  the  declassification/downgrading  schedule  of  the  report,  using  the 
abbreviations  for  declassification/downgrading  schedules  listed  in  paragraph  4-207  of  DoD  5200. 1-R. 

Block  16.  Distribution  Statement  of  the  Report.  Insert  here  the  applicable  distribution  statement  of  the  report  from  DoD 
Directive  5200.20,  "Distribution  Statements  on  Technical  Documents. ” 


Block  17  Distribution  Statement  (of  the  abstract  entered  in  Block  20,  it  different  from  the  distribution  statement  ot  the  report). 
Insert  he^TtlTe^plicable  distribution  statement  of  the  abstract  from  DoD  Directive  S200.20.  "Distribution  Statements  on  Technical  Doe- 
uments. 99 


Block  18.  Supplementary  Notes.  Enter  information  notjncluded  elsewhere  but  useful,  such  as:  Prepared  in  cooperation  with 
Translation  of  for  by)  . . . Presented  at  conference  of  ...  To  be  published  in 


sufficien  . 
of  Engineering 


Block  19  Key  Words.  Select  terms  or  short  phrases  that  identify  the  principal  subjects  covered  in  the  report,  and^j 
itly  specific  and  precise  to  be  used  as  index  entries  for  cataloging,  conforming  to  standard  terminology.  The  DoD 
eering  and  Scientific  Terms”  ( TEST).  AD-672  000.  can  be  helpful. 


•re 

Thesaurus 


flKUICCIillH  ansa  * , ' - - 

Block  ">0  Abstract.  The  abstract  should  be  a brief  fnor  to  exceed  200  words)  factual  summary  of  the  most  significant  informa- 

tion contained  TiTthe  report.  If  possible,  the  abstract  of  a classified  report  should  be  unclassified  and  the  abstract  to  an  unclassified 
eport  should  consist  ofPpubl.cly-  releasable  information.  If  the  report  contain,  a significant  b,b  iogr.phy  or  literature  survey^nention 
it  here.  For  information  on  preparing  abstracts  see  "Abstracting  Scientific  and  Technical  Reports  of  Defense-Sponsored  RDTSsE, 


AD-667  000 


» 


I * 

* ] 


TABLE  OF  CONTENTS 
VOLUME  I 

I.  BACKGROUND  AND  OBJECTIVES  

II.  METHOD  

HI.  CONCLUSIONS  

A.  Overall  Results  

B.  Commentary  

C.  Postcript  


Page 

1 

6 

8 

8 

17 

18 


IV.  THE  STUDY  IN  DETAIL  

A.  Philosophy  and  Overall  Design  . 

B.  Sources  of  Information  Employed 

C.  Analysis  of  the  Results  

0.  Statistical  Analyses  


19 

19 

27 

36 

72 


1 


I.  Background  And  Objectives 

The  Department  of  Oefense  has  not  employed  paid  broadcast  advertis- 
ing In  support  of  military  recruiting  since  1971.  In  the  meantime 
the  military  services  have  developed  their  advertising  media  plans 
without  access  to  either  radio  or  television  advertising  except  on 
a public  service  basis. 

In  1975  the  Office  of  The  Secretary  of  Defense  (OSD)  began  an  analy- 
sis of  the  relative  effectiveness  of  paid  broadcast  advertising  In 
support  of  the  All  Volunteer  Force.  The  first  step  was  a study^ 
of  the  cost  efficiency  of  Including  paid  broadcast  In  service  adver- 
tising media  schedules.  In  this  Instance  efficiency  was  evaluated 
In  terms  of  physical  exposure  to  the  target  audience.  The  technique 
employed  was  an  analysis  of  audience  ratings  to  determine  the  rela- 
tive costs  of  various  media  In  accumulating  reach  and  frequency  of 

exposure  among  the  target  audience.  Results  suggested  that  employ- 

es, 

ment  of  paid  broadcast  (radio  and/or  television)  offers  advantages 

I 

in  either  of  two  directions: 

Achievement  of  greater  reach  and  frequency2^  for  a 
given  budget  level 

. 

1)  OSD  Media  Study,  April  25,  1975,  conducted  by  VI tt  Media 
International 

2)  Reach  is  defined  as  the  percent  of  the  target  audience  to  whom 
at  least  one  message  Is  delivered.  Frequency  Is  the  average 
number  of  messages  delivered  per  recipient. 


Achievement  of  similar  reach  and  frequency  for 
lower  budget  levels. 

However,  Physical  exposure  Is  only  the  first  step  in  effective 
advertising.  Ultimate  effectiveness  depends  also  upon  the 
ability  of  the  medium  to  convey  comprehensible,  memorable  In- 
formation to  the  prospect  which  may  affect  his  attitudes  or 
behavior  In  a desired  direction. 

Consequently  a decision  was  made  In  the  Spring  of  1975  to 
carry  the  investigation  further  by  testing  the  capability 
of  paid  radio  advertising  to  convey  service  advertising 
messages  and  to  accomplish  advertising  objectives.  All 
four  services  agreed  to  participate  simultaneously  In  the 
test. 

Since  media  efforts  now  exclude  paid  radio,  the  central 
question  was  how  radio  would  perform  when  gross  Impressions 
against  young  men  between  the  ages  of  17  and  24  are  equal- 
ized for  a schedule  containing  a mix  of  radio  and  other  media 
versus  a schedule  containing  other  media  alone. 

The  term  "gross  Impressions,"  used  In  this  context,  refers 


to  the  sum  total  of  exposures  to  the  full  list  of  media  used 
during  a specified  period  of  time. 


It  Is  recognized  that  the  objectives  of  the  test  are  In  a 
sense,  relatively  modest.  For  example.  It  would  have  been 

I • 

possible  to  test  several  levels  of  radio  simultaneously  to 
attempt  to  determine  the  optimum  mix  of  radio  and  other 
media.  However,  given  the  generally  negative  experience  of 
past  media  tests  in  other  areas.  It  was  reasoned  that  It 
would  be  unwise  to  be  more  ambitious  In  the  first  experiment 
for  the  armed  services.  It  was  hoped  that  one  solid  clean 
experience  would  lay  the  groundwork  for  future  work  with 
controlled  experiments.  Accordingly  the  test  reported  upon 
here  attempts  simply  to  see  whether  the  addition  of  radio 
to  the  media  schedule  would  have  any  effects  and,  if  so, 
what  kinds  of  effects  they  would  be. 

There  are,  of  course,  a large  number  of  ways  In  which  the 
effectiveness  of  advertising  can  be  measured.  The  most 
important  one  Is  the  desired  end  result  — accessions. 

However,  enlistment  Impact  is  probably  also  the  most  difficult 

' 

criterion  to  influence.  One  reason  for  this  Is  the  role 
played  by  the  recruiter.  It  seems  likely  that  advertising 


L 
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does  not  usually  cause  accessions  directly.  Rather  it  may 
Influence  attitudes  or  result  In  an  inquiry  of  a recruiter. 
Whether  an  accession  results  depends  importantly  on 
how  the  recruiter  does  his  or  her  job. 

Advertising,  when  It  Is  successful,  operates  In  a variety 
of  ways.  One  potential  effect,  often  obtained  In  the  early 
stages  of  a campaign.  Is  a change  in  the  level  of  awareness 
of  the  service  being  advertised  and/or  of  Its  advertising. 

A second  possible  effect  Is  a change  In  the  amount  and  nature 
of  the  Information  being  communicated.  Thirdly,  If  the  In- 
formation communicated  favorably  Interacts  with  the  value 
systems  and  pre-disposition  of  the  person  exposed  to  the 
advertising,  that  person's  attitudes  toward  joining  a service 
may  change  in  a positive  direction.  And,  finally,  the  exposed 
person  may  take  some  specific  action  toward  enlistment.  This 
may  take  the  form  of  an  Inquiry  by  mall,  by  telephone,  or  In 
person.  There  are  no  clearcut  rules  as  to  which  of  these 
criteria  are  apt  to  be  affected  by  a given  campaign,  nor  In 
what  sequence  they  are  likely  to  be  affected  If  they  are 
affected.  The  safest  procedure  is  to  measure  them  all. 

That  Is  what  was  done.  The  key  criteria  measured  were: 


. Contracts  for  accession 

. Inquiries  by  mall,  telephone  and  In  person  (at 
bo»,i  national  and  local  levels) 

. Pre-disposition  toward  joining  a service 

. Awareness  and  knowledge  of  specific  programs  and 
benefits  offered  by  Individual  services 

. Awareness  of  armed  forces  advertising 

The  foregoing  list  of  criteria  Is  arranged  in  the  order  of 
the’r  presumed  Importance.  In  other  words,  the  most  im- 
portant effect  that  could  possibly  occur  would  be  a direct 
Increase  In  contracts  for  accession.  Next  would  be  people 
taking  actions  that  might  be  precursors  to  joining  a service. 
Then  come  favorable  attitudes,  knowledge,  and  awareness  of 
advertising  — in  that  order.  Interestingly,  the  more  Im- 
portant the  criterion,  the  more  difficult  it  traditionally 
has  been  to  measure  It  and  attribute  It  to  advertising 
alone.  The  easiest  measure  to  change  Is  advertising  aware- 
ness and  the  hardest  contracts  for  accession. 


6. 


?I.  Method 


The  research  design  employed  was  a standard  before  and  after  de- 
sign with  test  and  control  markets.  A series  of  variables,  taken 
to  be  related  to  advertising  effectiveness,  was  measured  before 
the  test  was  begun,  at  intervals  during  the  test,  and  again  after 
it  had  been  completed.  Changes  in  test  markets  were  contrasted 
with  changes  in  control  markets.  Test  markets  employed  some  radio 
in  their  media  schedules;  control  markets  did  not. 

In  all,  eight  triads  of  matched  markets  were  monitored  during 
the  test.  Within  each  triad  two  markets  served  as  test  markets 
for  one  or  more  services  with  the  third  market  serving  as  a 
control.  Services  used  radio  either  by  themselves  or  in  com- 
bination with  two  other  services.  A full  schemata  of  the  design 
Is  shown  In  Chart  1 on  the  following  page. 

A number  of  sources  were  utilized  in  assembling  an  extensive 
data  bank  for  the  markets  involved  in  the  test.  Primary  sources 
were  a large  scale  telephone  survey  of  men  17  - 24  and  an  audit 
of  recruiting  stations.  A full  description  of  the  Information 
obtained  and  its  sources  can  be  found  in  Section  IV,  The  Study 
in  Detail.  A complete  listing  of  variables  appears  in  appendix 


B,  The  Data-Base  (Vol.  II). 


CHART  1 

RESEARCH  DESIGN 


SINGLE  ADVERTISER  MARKET  TRIADS 


Air  Force 

Army 

Marine  Corps 

Augusta 

Navy 

Test  1 

Bowling  Green 

Columbus,  Ohio 

Lansing 

Test  2 

Boise 

Atlanta 

Dothan 

Knoxville 

Control 

Casper 

Omaha 

Charleston, 

S.C. 

Binghamton 

THREE-SERVICE 

SIMULTANEOUS  ADVERTISER  MARKET  TRIADS 

AF/A/MC 

A/MC/N 

MC/N/AF 

N/AF/A 

Test  1 

Denver 

Louisville 

Valdosta 

A1 toona 

Test  2 

Kansas  City 

Seattle 

Baton  Rouge 

Spokane 

Control 

Albany 

Portland 

Shreveport 

Yakima 
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I a I . Conclusions  And  Implications 

A.  Overall  Findings 

There  are  two  levels  at  which  the  results  of  an  experiment 
may  be  analyzed  and  interpreted. 

Statistically  Significant  Findings 

The  first  is  by  the  standard  of  statistical  significance, 
that  Is,  by  determining  though  a rigorous  statistical 
procedure  whether  the  observed  results  on  certain 
criterion  variables  could  have  occurred  by  chance 
more  than  one  time  In  twenty  theoretical  repetitions 
of  the  experiment. 

Twenty  one  criterion  measures  selected  as  reflecting 
various  aspects  of  the  effectiveness  of  advertising 
were  considered  for  this  type  of  analysis.  However, 
many  of  them  were  highly  Intercorrelated,  thus  inter- 
fering with  statistical  tests  requiring  Independent 
units. 

To  circumvent  this  problem  a factor  analysis  was  per- 


formed  on  the  21  variables  In  order  to  aid  In  Identify- 
ing specific  measures  which  were  relatively  Independent, 
logically  distinct  and  representative  of  the  basic 
content  all  21  effects  measured.  (See  Factor  Analysis 
Comnen'.s,  Pages  72-74.) 

For  such  criteria  were  identified: 

. Accessions 

. Local  Inquiries  (from  the  station  audit) 

. Attitudes  toward  the  service  (as  reflected  by 
a specially  weighted  rating  scale) 

. Awareness  of  radio  advertising 

An  analysis  of  Variance  and  Covariance1  was  performed 
to  test  the  statistical  significance  of  test  versus 
control  differences  on  these  four  variables. 


1.  The  Analysis  of  Variance  technique  consider  both  the  size 
of  observed  differences  between  groups  of  test  and  control 
markets  and  also  the  size  of  difference  between  Individual 
test  markets  and  between  Individual  control  markets.  If 
variations  among  test  markets  and  among  control  markets  are 
large  relative  to  variations  between  the  groups  of  test  and 
control  markets  significance  is  weakened.  See  page  75  for 
details. 


V 


The  four  may  be  confidently  assumed  to  stand  as  sur- 
rogates for  all  the  21  criterion  variables  for  which 
data  was  available. 

i 

Changes  In  the  level  of  awareness  of  radio  advertising 
were  found  to  be  significant.  None  of  the  other  three 
variables  showed  significant  effects. 

We  may  conclude  with  confidence  that  the  use  of  radio 
for  Armed  Forces  Recruiting  advertising  Is  effective  in 
achieving  a recallable  Impression  among  the  target 
audience. 

In  respect  to  all  other  levels  of  effectiveness  our 
conclusions  must  be  far  more  tentative  and  quallfleo. 
Nevertheless  certain  Indications  In  the  data  on 
behavioral  and  attitudlnal  shifts  should  not  be 
Ignored. 

Patterns  And  Indications 
— 


i 


It  was  recognized  In  advance  of  the  test  that  attltu- 
dinal  and  behavioral  changes  in  prospects  would  be 
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difficult  to  affect  with  variations  In  the  media  mix. 

This  Is  not  a test  of  advertising  for  such  as  tooth- 
paste or  cake  mix  where  attitudes  and  behavioral  pat- 
ter is  are  not  deeply  ingrained  and  thus,  to  some  ex- 
tent, are  malleable.  Rather,  we  are  dealing  with 
well-known  national  Institutions  and  with  career 
choices  toward  which  most  people  have  strong  feelings 
and  hold  well  developed  stereotypes. 

Thus  It  seems  appropriate  to  search  for  indications  of 
small  shifts  In  the  patterns  of  response  as  well  as  for 
major  statistical ly  significant  results.  Two  facts  sug- 
gest that  some  small  positive  effects  did  occur  in  respect 
to  prospect  behavior  and  "objective"  attitude  toward  the 
services,  enlistment  In  general,  but  not  in  respect  to  "sub- 
jective" attitude  as  measured  by  personal  likelihood  to  enlist. 

First  when  all  21  criterion  variables  are  considered 

l » 

there  Is  a regularity  of  response  from  service  to 
service  and  from  variable  to  variable  particularly  in 
the  area  of  local  inquiries.  Accessions  themselves 
are  somewhat  higher  In  radio  markets  for  the  Army, 

Air  Force  and  Marines,  but  not  for  the  Navy.  (See 
Chart  3 page  16.)  This  analysis  suggests  that  the 
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patterns  of  response  are  not  random  but  rather  reflect 
the  effects  of  some  fundamental  underlying  factors 
commrn  to  the  various  services. 

The  second  fact  worth  noting  with  respect  to  patterns 
of  response  Is  the  parallelism  between  patterns  of  re- 
sponse for  the  first  and  second  halves  of  the  test. 

The  addition  of  second  half  results  did  very  little  to 
change  the  patterns  established  during  the  first  half. 

Moreover,  the  changes  that  did  occur  were  in  the  direc- 
tion of  even  greater  service- to-service  consistency. 

Changes  toward  consistency  far  outnumbered  those  awav 
from  consistency  (See  Page  81).  Had  the  test 
been  continued  for  a longer  period  of  time,  it  is 
reasonable  to  assume  that  still  fewer  inconsistencies 
In  response  patterns  from  service  to  service  would 
have  remained.  This  means,  of  course,  that  given  a 
longer  test,  the  probability  of  attaining  statistical 
significance  would  also  be  likely  to  be  improved. 

Consequently,  we  may  cautiously  Infer  that,  had  the 
test  continued  it  would  eventually  have  shown  statis- 
tically significant  radio  effects  on  accession  station 
Inquiries  and  perhaps  "objective"  attitudes  (as  well 

1 
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as  the  previously  noted  significant  effects  on  awareness 
of  radio  advertising). 


Furthermore,  even  in  these  test  markets  during  the  test 
period  magazines  received  by  far  the  largest  proportion 
of  advertising  weight  --  at  least  two-thirds.  At  the  same 
time  the  proportion  of  dollars  spent  on  radio  ranged  from 
a high  of  31*  to  a low  of  1 7% . 


Let  us  now  consider  the  patterns  shown  by  the  criterion 
measures  listed  In  Chart  3.  Several  types  of  measures 
are  Incorporated.  They  have  been  grouped  Into  sets  on 
the  basis  of  logical  similarity. 

Accessions  are  DOD  contracts  for  accessions.  National 
Inquiries  are  compiled  by  fulfillment  houses.  The  local 
Inquiries  are  based  on  the  audits  of  recruiting  stations. 
Recalled  actions  were  gathered  from  the  consumer  survey, 
as  were  the  attltudlnal  measures.  The  latter  are  largely 
attitude  scale  ratings.  The  measures  labeled  "Probability 
(linear)"  and  "Probability  (log)"  come  from  the  same  scale 
but  utilize  differing  scoring  systems  for  the  various 
points  on  the  scale. 
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CHART  2 


PROPORTION  OF  ADVERTISING  DOLLARS 
_ SPENT  IN  THE  VARIOUS  MEDIA 
(OVER  THE  TEST  PERIOD1  IN  THE  TEST  MARKETS) 


AIR 

FORCE 

ARMY 

MARINE 

CORPS 

NAVY 

(Number  of  test  markets) 

(8) 

(8) 

(8) 

(8) 

Percentage  of  respective  service 

advertising  dollars  bv  medium 

% 

X 

X 

X 

Radio 

17.7 

20.2 

30.9 

31.0 

Magazine 

76.5 

75.2 

64.1 

66.1 

Outdoor 

5.8 

3.7 

3.1 

2.9 

Sunday  Supplement 

• 

.9 

1.9 

1.  September  7 to  December  28,  1975 


The  "Idea  of  enlistment"  Is  also  a scaled  rating  and 
comes  from  the  consumer  survey  as  do  the  two  aware- 
ness measures. 

An  overview  of  the  directional  changes  that  occurred  dur- 
ing che  test  can  be  had  by  scanning  Chart  3.  Pluses  In- 
dicate net  movement  that  Is  favorable  to  the  radio  schedule 
without  regard  for  statistical  significance  and  minuses  net 
movement  that  favors  the  non-broadcast  schedule.  As  a gen- 
eralization, It  Is  evident  that  the  direction  of  net  acces- 
sions movement,  changes  In  Inquiries,  the  awareness  of 
service  advertising  and  the  attractiveness  of  the  "objective" 
Idea  of  joining  a service,  all  favor  the  radio  markets.  On 
the  other  hand,  changes  in  subjective  attitudes  about  per- 
sonal likelihood  of  enlisting  tend  to  favor  the  non-broadcast 
markets.  Recalled  actions  are  mixed. 

In  sum,  the  overall  results  must  be  considered  favorable  to 
the  use  of  radio.  The  net  change  In  awareness  of  radio  ad- 
vertising Is  statistically  significant.  Host  other  net 
changes.  Including  the  changes  In  the  key  accessions  measure. 
>oint  tentatively  In  the  direction  of  superior  performance 
In  radio  markets.  Finally,  under  the  most  conservative 
Interpretation  of  the  test  results,  there  Is  little  risk 
associated  with  the  addition  of  radio  to  service  media  mixes 
and  a clear  possibility  of  longer  term  gains  as  advertisin' 
effects  have  time  to  cumulate. 


I 
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CHART  3 


AIR 

MARINE 

Criterion  Variables 

POD 

FORCE 

ARMY 

CORPS 

NAVY 

♦Accessions 

♦ 

+ 

+ 

+ 

- 

National  Inquiries  - 

Total 

+ 

+ 

+ 

- 

+ 

Phone 

+ 

- 

+ 

_ 

+ 

Mall 

♦ 

+ 

+ 

- 

+ 

Local  Inquiry  Audits  - 

♦Total 

♦ 

+ 

•f 

+ 

♦ 

Phone 

♦ 

+ 

+ 

+ 

+ 

Walk-In 

♦ 

♦ 

+ 

+ 

+ 

First  male  app. 

+ 

+ 

+ 

+ 

+ 

Recalled  Actions  - 

. 

Read  direct  mall 

♦ 

+ 

■f 

+ 

• 

Responded  to  mailing 

- 

- 

- 

+ 

- 

Called  toll  free  no. 

- 

- 

♦ 

- 

+ 

Sent  In  coupon 

- 

- 

- 

♦ 

- 

Mall  + toll  free  + coupon 

- 

- 

- 

♦ 

m 

Attitudes  - 

In  Plans  for  1 

Next  Few  Years 

- 

- 

- 

- 

- 

Some  posslbl 1 

llty  of  Joining 

- 

- 

- 

- 

- 

Very/fa Irly  1 

likely  to  Join 

- 

- 

- 

- 

- 

Probability  1 

[linear) 

- 

- 

- 

- 

• 

♦Probability  1 

(log) 

— 

- 

- 

- 

- 

Idea  Of  Enlistment 

♦ 

+ 

♦ 

♦ 

Awareness  Of  Advertising 

+ 

+ 

♦ 

♦ 

4 

♦Awareness  Of  Radio  Advertising 

♦ 

+ 

+ 

+ 

♦ 

4t 

+ * favors  radio  markets 
- = favors  non-broadcast  markets 


♦Variables  tested  for  significance 
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B.  Commentary 

Despite  huge  expenditures  on  advertising  research  In  the 
past,  most  professional  advertising  researchers  would  be 
willing  to  admit  that  the  process  by  which  advertising  af- 
fects behavior  in  any  given  circumstance  Is  far  from  clear. 
Many  people  believe  that  attitude  change  largely  follows 
behavioral  change.  Results  of  this  test  suggest  that  for 
service  advertising  this  Is  a very  real  possibility.  The 
awareness  and  behavioral  measures  appear  to  be  moving  In 
directions  favorable  to  the  use  of  radio.  Although  the 
attltudinal  measures  are  the  farthest  of  any  from  reaching 
significant  levels,  they  are  consistently  pointing  In  the 
opposite  direction.  Accordingly  some  conments  on  how  an 
opposite  movement  might  occur  may  be  In  order.  As  suggested 
above  the  first  possibility  Is  that  there  Is  a lag  effect 
and  that  attitudes  will  eventually  move  in  the  same 
direction  as  the  other  measures. 

A second  hypothesis  that  might  explain  the  differences  in 
the  performance  of  the  attitudinal  and  behavioral  measures 
Is  polarization.  In  other  words.  It  Is  possible  that  the 
heightened  levels  of  effort  triggered  positive  actions  on 
the  part  of  people  who  were  favorably  predisposed  toward 
the  services  but  that  radio  messages,  perhaps  partially  be- 
cause  of  their  frequency,  actually  reinforced  negative  at- 
titudes among  people  who  were  not  favorably  predisposed. 


* 
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Note  that  "objective"  attitudes  toward  the  general  Idea  of  a young 
man  joining  the  armed  forces  tended  to  Improve  In  radio  markets. 
Only  the  more  deeply  held  "subjective"  attitudes  about  one's  own 
personal  likelihood  of  enlistment  tended  to  be  negatively  effected. 

A final  hy'.othesls  Is  simply  that  broadcast  and  non-broadcast  media 
operate  differently  — that  radio  Is  a more  effective  catalyst  In 
triggering  actions  but  that  non-broadcast  Is  more  effective  in 
coninun lea ting  Information  and  in  developing  favorable  attitudes. 

One  last  comment  Is  In  order.  While  the  parallelism  from  service 

to  service  Is  encouraging  In  respect  to  the  probable  effectiveness 

of  radio  It  may  also  suggest  that  the  services  are  competing  with 

each  other  for  the  same  prospects,  or  at  least  the  people  In  the 
* 

Individual  service  markets  behave  similarly  with  respect  to  the 
observed  advertising  effects. 


C.  Postscript 

One  more  statistical  analysis  Is  planned  In  conjunction  with  this 
research.  An  audit  was  made  of  public  service  activities  and 
results  will  be  analysed  as  soon  as  they  have  been  compiled. 

Also,  as  Is  apparent,  an  enormous  databank  has  been  assembled  and 
supplementary  analyses  beyond  those  summarized  here  are  possible 
In  the  future. 
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IV.  THE  STUDY  IN  DETAIL 

A.  Philosophy  and  Overall  Design 

In  designing  the  test,  the  principles  of  experimental  design, 
developed  originally  for  tightly  controlled  agricultural  ex- 
periments, were  employed.  These  allow  the  researcher  to  sort 
out  the  effects  of  the  variable  of  Interest  (in  this  case  our 
two  types  of  media  schedules)  from  the  effects  of  the  many 
other  variables  that  Inevitably  Intrude  on  a test  of  this  sort 
and  are  apt  to  mask  the  effects  of  the  key  variable.  In  real 
world  experiments,  some  compromises  tracing  to  budgetary  and 
time  limitations  are  Inevitably  required.  This  section  spells 
out  the  nature  of  those  compromises. 

1.  The  Unit  of  Analysis 

Markets  were  chosen  as  appropriate  test  units  because  they 
were  the  smallest  geographical  unit  within  which  media,  in 
particular  radio,  could  be  manipulated  efficiently.  After 
discussions  with  service  advertising  media  planners.  It 
was  decided  that  markets  would  be  defined  as  SMSA's 
(Standard  Metropolitan  Statistical  Areas)  because  much  of 
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the  data  required  for  matching  and  for  evaluative  pur- 
poses was  collected  using  that  particular  form  of 
market  definition. 

2.  Combinations  of  Services  to  be  Represented 

Further  discussions  with  service  advertising  managers 
Indicated  that  there  would  be  relatively  few  Instances 
where  all  four  services  would  be  advertised  In  the  same 
markets  simultaneously.  At  the  same  time  pairs  and  trios 
of  services  did  seem  likely  and  it  was  hypothesized  that 
there  might  well  be  interaction  effects  between  the  com- 
binations of  services  doing  the  advertising  in  a particular 
market.  • 

Accordingly,  a compromise  design  was  selected  one  that 
allowed  measurement  of  two  of  the  many  conditions  that 
might  result  should  the  services  be  permitted  to  employ 
paid  radio  advertising  — the  condition  when  a service  is 
advertising  alone  and  the  condition  where  It  Is  advertising 


with  two  other  services.  It  was  hoped  that  reasonable 
Interpolations  might  be  made  for  the  missing  conditions 
should  significant  effects  be  found. 
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3.  The  Experimental  Design 

One  of  the  principal  tradeoffs  In  selecting  test  and  control 
mar’.ots  is  between  prcjectabillty  and  the  precision  of 
market  matching.  Markets  can  be  dispersed  geographically, 
which  aids  projectabll Ity,  or  they  can  be  concentrated  In 
clusters,  which  aids  matching.  Complicating  the  situation 
was  the  necessity  of  representing  each  of  the  four  services 
alone  and  In  combination  with  the  other  services. 

The  design  selected  represented  a compromise  between  pro- 
jectablllty  and  reliability  with  greater  emphasis  on  the 
latter  characteristic.  It  required  eight  triads  of  matched 
markets (See  Chart  1,  Pg.7).  Within  each  triad,  two  markets 
were  to  serve  as  test  markets  for  one  of  the  test  conditions 
and  one  as  a control.  Test  markets  were  so  named  because 
some  form  of  paid  radio  was  used  In  them.  Control  markets 
maintained  a non-radio  schedule.  The  use  of  a single  con- 
trol market  In  each  triad  was  a concession  to  cost.  Also, 
there  was  particular  concern  about  having  a large  sample  of 
enough  markets  for  the  test  condition.  Occasionally, 

In  the  course  of  a test  like  this,  markets  have  to  be 
dropped  for  one  reason  or  another  (e.  g.,  natural  disasters). 
An  extra  market  serves  to  protect  against  this  contingency. 
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Aside  from  the  economic  advantage,  It  was  felt  that  It 
might  be  possible.  If  necessary,  to  make  some  of  the  con- 
trol  markets  do  double  duty  against  test  conditions  In 
triads  outside  of  their  own. 

4.  Market  Hatching 

. 

The  history  of  media  testing  Is  not  very  encouraging  to 
people  who  hope  to  conduct  such  tests.  Typically  the 
effects  of  extraneous  variables  overwhelm  the  effects  of 
the  test  variables  and  results  are  virtually  Impossible 
to  read.  To  hold  this  risk  to  the  lowest  possible  levels, 
great  care  was  taken  In  matching  test  and  control  markets 
before  the  beginning  of  the  test. 

To  begin  with,  a list  of  175  possible  SMSA's  was  compiled. 

The  largest  155  were  markets  for  which  Arbltron  ratings 
were  available.  Arbltron  ratings  are  a standard  radio 
source.  Ratings  for  larger  markets  are  compiled  from  con- 
sumer diaries.  A set  of  20  smaller  markets  was  also 
Included  to  provide  some  representation  for  that  particular 
size  bracket. 


The  list  was  then  "purified"  by  excluding  markets  considered 
too  large  for  testing  purposes,  markets  with  some  special 
media  problems  and  markets  with  large  military  or  naval  bases. 

For  che  surviving  138  markets  a regression1 2 ^ was  run  to  Ident- 
ify variables  associated  with  quality  accessions  (high  school 
graduates  In  mental  categories  I,  II  and  III  divided  by  QMA). 

The  Independent  variables  used  In  the  regression  were  largely 

2) 

obtained  from  a databank  of  demographic  and  economic  Informa- 
tion previously  compiled  from  Department  of  Commerce  records 
by  Russ  Haley  & Associates,  Inc.  for  use  In  market  testing 
problems.  To  this  Information  were  added  several  series 
available  from  data  compiled  by  the  General  Research  Corpora- 
tion, namely  unemployment  rates,  wage  rates,  number  of 
recruiting  stations,  qualified  military  available,  and 
accessions.  The  multiple  regression  program  used  was  an 
expanded  version  of  BMO  02R  from  the  Biomedical  Program 
Library  of  the  University  of  California  at  Los  Angeles.  The 
resultant  equation  Is  shown  In  Chart  4 on  the  following  page. 


1)  It  Is  recognized  that  the  Inclusion  of  QMA  on  both  sides  of  the  equation 
Is  questionable  practice  In  some  situations.  However,  in  this  Instance, 
Interest  centered  around  Identifying  variables  that  helped  to  explain 
residual  variations. 

2)  Over  100  demographic  and  economic  series  had  been  factor  analyzed  and 
after  the  elimination  of  redundancy  reduced  to  a set  of  thirty-two 
"market  variables."  These  are  listed  In  Appendix  B of  Volume  II. 
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CHART  4 

REGRESSION  MATCHING  PROCESS 

Multiple  R * .5532 

Regression  Equation 

Accesslons/QMA  * -.00001  + .5772  (Recrulters/QMA) 

-.7814  (QMA)  - .2031  (X  Working  Women) 

-.1857  (X  Owner-Occupied  Housing)  + .1498  (X  Black) 
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Next  the  138  markets  were  clustered  Into  groups  of 
markets  with  similar  profiles  using  the  Slngleton-Kautz 
algorithm  of  the  Stanford  Research  Institute  and  the 
variables  shown  in  Chart  3.  Then,  random  starting  points 
within  clusters  were  chosen  and  triads  of  matched  markets 
were  developed  around  each  starting  point  using  a cor- 
relation matrix  of  markets.  Finally,  markets  within 

triads  were  randomly  assigned  to  the  test  and  control 

» 

conditions. 

However,  even  the  best  pre-test  matching  procedure  Is 
subject  to  some  risk.  By  bad  luck  the  random  aspects  of 
the  selection  process  can  cause  unbalanced  test  and  con- 
trol groups.  Moreover,  markets  that  appeared  to  be 
matched  on  one  basis  before  the  test  began  may,  once 
further  data  become  available,  appear  out  of  balance. 

Thus,  to  guard  against  random  mismatches,  an  extensive 
post-analysis  was  made  of  the  base  period  differences 
between  test  and  control  markets. 

An  examination  of  148  variables,  30  of  which  were  designat- 
ed as  criterion  measures  and  the  remainder  as  covariates. 


showed  that  very  few  of  the  criterion  measures  were  mis- 
matched (fewer  than  would  be  expected  by  chance).  That  Is, 
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test  and  control  means  Mere  essentially  the  same.  Results 
Mere  similar  for  the  covariates.  Moreover,  none  of  the 
latter  group  bore  a very  strong  relationship  to  any  of  the 
criterion  measures. 

5.  Matching  During  the  Test  Period 

Sometimes  In  the  course  of  a test,  markets  Mhlch  Mere 
Initially  Mell  matched  become  mismatched.  Trends  can  develop 
In  Individual  markets  that  distort  the  results  of  the  test. 

The  performance  of  co-variates  provides  a check  on  the  ex- 
tent to  Mhlch  this  Is  a risk. 

The  Data  Base  section  (covariates)  of  the  appendix  (VoT .II) 
shOMS  the  close  parallelism  betMeen  the  situations  In  the 
test  markets  and  In  the  control  markets.  Test  markets  are 
slightly  larger  than  control  markets  In  the  aggregate.  Hom- 
ever,  the  profiles  across  variables  Mlthln  markets  are 
virtually  Identical,  giving  added  confidence  to  the  validity 
of  test  results. 

A somewhat  different  matching  problem  Is  the  problem  of  match- 
ing the  quality  of  advertising  copy.  It  Is  sometimes  maintained 
In  cross-media  tests  that  the  tests  are  not  tests  of  the 
media  at  all.  Rather,  It  Is  claimed,  they  are  tests  of 
copy.  If  the  print  executions  are  Inspired  and  the  radio 
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commercials  are  ordinary,  then  print  will  win  the  test.  Con- 
versely, if  the  radio  commercials  are  superior,  then  radio 
will  win. 

Two  factors  suggest  that  copy  is  not  a major  problem  in  inter- 
preting the  results  of  this  test.  The  first  Is  the  general 
parallelism  of  results  by  service.  Because  each  service  uses 
a different  advertising  agency,  the  likelihood  of  superior 
executions  for  the  same  medium  In  every  service  Is  reduced. 
Another  reassuring  fact  Is  the  similarity  of  the  nature  of 
advertising  recall  for  test  and  control  markets.  In  every 
service  the  nature  of  the  playback  suggests  that  matching  on 
copy  Is  also  acceptable. 

Sources  of  Information  Employed  In  the  Investigation 

Five  major  sources  of  Information  were  employed  In  the  course  of  the 
Investigation. 

. A telephone  survey  of  consumers 

Three  waves  of  1,800  Interviews  each  of  men  17  - 24  and  employ- 
ing a probability  sample  of  the  twenty- four  markets. 

. An  audit  of  recruiting  stations 

All  stations  In  the  twenty-four  markets  were  visited  and  a 
follow-up  telephone  audit  was  made  of  the  largest  stations. 

Service  fulfillment  house  data  on  Inquires  and  000  accessions 
data  (supplied  on  a market  and  quality  basis  by  General  Research 
Corporation). 
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. A databank  based  on  Department  of  Commerce  records 
. Service  advertising  agencies 

Highlights  of  the  procedures  used  In  gathering  Information  from 
each  of  there  sources  are  covered  In  the  following  paragraphs. 

1.  The  Consumer  Survey 

The  role  of  the  consumer  survey  was  to  provide  Information  on 
the  criterion  measures  relating  to  actions  taken  (e.  g..  In- 
quiries recalled)  pre-disposition  toward  the  services,  know- 
ledge of  their  programs,  and  awareness  of  armed  forces  ad- 
vertising. In  addition,  data  on  a host  of  covariates  were 
gathered. 

The  term  "covariates"  has  been  used  previously  but  not  fully 
defined.  The  general  research  design  employed  calls  for  moni- 
toring each  market  before  the  beginning  of  the  actual  test  in 
order  to  establish  a normal  or  "base"  level  for  that  market. 
During  the  test  period,  the  changes  of  each  market  from  its 
base  are  then  monitored  and  the  changes  In  the  test  markets 
are  compared  with  those  of  the  control  markets.  In  a perfect 
test,  that  Is  all  that  would  be  required.  However,  In  the  real 
world,  many  variables  beyond  those  that  are  known  to  be  vary- 


Ing  can  affect  the  criterion  measures.  Fortunately,  If  It 
Is  possible  to  measure  them.  It  Is  also  possible  to  make 
statistical  adjustments  for  their  effects  where  their  effects 
are  significant.  These  variables  are  called  co-variates, 
because  they  co-vary  with  the  measures  of  direct  interest 
(the  criterion  measures). 

To  maximize  the  chance  of  a meaningful  analysis,  measure- 
ments were  made  of  a large  number  of  co-variates  that  were 
thought  might  have  an  Influence  on  the  criteria. 

Questioning  covered  a variety  of  areas.  Including: 

. The  probability  of  choosing  various  career  al- 
ternatives, Including  enlistment  In  each  armed 
service 

. Attitudes  toward  each  service  and  toward  the 
military  In  general 

. Awareness  and  knowledge  of  recruitment  programs 
and  the  communications  objectives  of  individual 
services 
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. Awareness  and  recall  of  advertising  copy 

. Recall  of  contacts  made  with  or  Inquiries  made 
of  services  or  recruiting  personal 

. Media  habits 

. Past  family  associations  with  the  armed  services 

. School  grades  and  types  of  educational  programs 
enrolled  In 

. Demographic  data  such  as  age.  education,  occupation, 
and  marital  status.  Income  and  residential  status 

The  survey  Itself  was  a three-wave  before/after  telephone 
survey  conducted  In  test  and  control  markets  among  a proba- 
bility sample  of  men  17  to  24  years  of  age  with  less  than 
three  years  of  college  and  no  prior  military  Involvement. 

The  first,  or  base,  wave  was  conducted  just  before  the  start 
of  test  advertising  (between  August  21  and  September  7).  A 
second  wave  was  conducted  at  the  midpoint  of  the  test  period 
(between  October  11  and  October  25)  and  a third  at  Its  close 
(between  December  6 and  December  19). 
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2.  The  Audit  of  Recruiting  Stations 

The  primary  purpose  of  the  audit  of  recruiting  stations  Mas 
to  gather  data  on  the  volume  of  local  inquiries  received  by 
mall,  by  telephone,  or  In  person.  However,  it  was  felt  that 
these  also  might  be  affected  by  covariates  and  that  the 
nature  of  the  recruiting  stations  might  In  turn  have  an  ef- 
fect upon  the  rate  of  accessions  and  other  performance 
criteria.  Accordingly,  once  again  Information  was  obtained 
on  a large  number  of  potential  covariates.  These  Included: 

. Number  of  stations 

. Total  size  of  staff 

. Number  of  production  recruiters 

. Number  present  in  the  office  at  the  time  of  an 
audit  of  the  recruiting  station 

. Average  grade  of  production  recruiters 


. Number  of  hours  stations  are  open 
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. The  extent  to  which  stations  are  In  central  cities 

. Whether  they  are  In  retail  areas  or  residential  areas 

. Whether  they  are  In  non-white  areas 

. Whether  they  are  In  locations  such  as  storefronts, 

shopping  centers  or  malls 

. Whether  they  are  at  street  level 

. The  visibility  of  the  station 

. Whether  other  services  have  stations  in  the 
immediate  area 

. The  number  of  telephone  lines  and  instruments 

. Convenience  of  parking  facilities 

. Foot  traffic  past  offices  during  sample  periods 

The  data  listed  above  were  obtained  as  follows.  Each  of  the 


recruiting  stations  In  the  24  test  and  control  markets  was 
visited  and  Information  was  gathered  on  the  characteristics 
of  the  station.  Its  location.  Its  personnel,  and  its  methods 
of  operation.  In  addition,  a special  telephone  audit  was 
made  of  a representative  sample  of  high  traffic  stations. 
These  account  for  more  than  70%  of  all  Inquiries.  Recruiters 
were  asked  to  keep  track  of  unsolicited  Inquiries  by  mail  or 
In  person  during  a random  time  sample  of  the  hours  during 
which  the  stations  are  open.  About  thirty  seven-hour  days, 
or  about  two  hundred  hours  In  total,  were  audited  in  each 
market.  A typical  station  was  audited  about  forty  hours 
during  the  base  period  and  about  eighty  hours  during  the 
test  period. 

Service  Fulfillment  House  Data  on 
Inquiries  and  POD  Accessions  Data 

Inquiries  are  received  at  national  centers  as  well  as  by  in- 
dividual recruiting  stations.  Inquiries  received  at  these 
centers  but  originating  In  test  or  control  markets  were  tabu- 
lated as  part  of  the  Input  data  and  represent  one  of  the 
criterion  measures. 
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DOD  data  on  contracts  for  accession  were  compiled  for  all  test 
and  control  markets  for  the  base  and  test  periods.  These  contracts 
were  limited  to  diploma  (actual  and  expected)  high  school  gradu- 
ates In  mental  categories  I,  II  and  III. 

4.  The  Databank 

The  data  bank  mentioned  earlier  In  conjunction  with  the  marketing 
matching  process  also  has  potential  value  in  providing  covariate 
data.  It  contains  variables  such  as: 

. Unemployment  rates 
Wage  rates 

QMA  (Qualified  Military  Avallables) 

. Population 

. Percent  of  the  population  that  is  black 
Percent  owner  occupied  dwelling  units 
Demographic  characteristics  of  the  market 

It  comes  from  several  sources,  primarily  from  a databank  of 
economic  and  demographic  information  compiled  largely  from 
Department  of  Commerce  records. 
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5.  Service  Advertising  Agencies 

Each  service  advertising  agency  provided  detailed  information 
on  media  delivery  In  each  of  the  twenty-four  markets.  These, 
of  course,  are  likely  to  be  Important  covariates.  They  in- 
clude measures  such  as: 

. "Reach"  obtained  in  each  market  (the  proportion  of 
people  in  the  target  group  exposed  to  one  or  more 
messages) 

, "Frequency"  obtained  in  each  market  (the  average 
number  of  exposures  per  exposed  person  in  the 
target  audience) 

. Gross  impressions  obtained  (the  total  number  of 
exposures) 

. Separate  data  for  Sunday  Supplements,  Outdoor  and 
Magazines 


1 


(See  Media  Plans,  Appendix  A,  Vol.  II) 


Analysis  of  the  Results 


To  reduce  the  data  base  to  a manageable  size,  the  survey  data  for 
Individual  respondents  was  aggregated  to  the  level  of  markets.  In 
doing  so,  some  consideration  was  given  to  the  possibility  of  using 
medians  rather  than  arithmetic  means  as  measures  of  central  tendency. 
However,  most  distributions  were  unimodal  in  character  so  means  were 
decided  upon. 

Another  consideration  concerned  the  most  appropriate  base  period. 

The  study  had  been  designed  around  an  August  base  period.  However, 
both  accessions  and  fulf • 1 linent  house  data  on  inquiries  were  avail- 
able for  longer  historical  periods.  Thus,  It  would  be  possible  to 
have  longer  bases  for  those  two  criteria.  However,  all  of  the  cri- 
teria relating  to  local  inquiries,  attitudes  and  awareness  were 
available  only  for  the  August  base.  The  choice,  therefore,  was 
whether  to  have  bases  of  inconsistent  length  in  order  lo  use  as  much 
base  period  information  as  possible,  or  whether  to  use  the  August 
base  uniformly.  It  was  decided  that  a consistent  time  frame  was 
the  more  desirable  alternative  because  It  allowed  clear  comparisons 
between  the  performances  of  all  the  criteria. 

Still  another  possibility  was  to  drop  the  base  period  entirely  and 
use  a matched  group  design,  simply  comparing  performance  in  test 
markets  during  the  test  with  that  of  the  control  markets.  However, 
this  possibility  was  discarded  when  it  became  apparent  that  such  a 
choice  would  add  substantially  to  the  variance.  Accordingly,  the 
analysis  is  focussed  on  the  change  that  occurred  between  the  base 
period  (August  1975)  and  the  13  weeks  during  which  radio  was  injected 
Into  the  media  mix  of  the  test  markets  (September  to  December  1975). 


Performance  of  the  Criterion  Measures 


This  section  discusses  in  some  detail  the  differences  In  the  behavior 
of  selected  performance  criteria  In  markets  using  radio  (test  markets) 
and  In  those  using  a non-broadcast  schedule  (control  markets).  It 
should  be  noted  at  the  outset  that  despite  the  apparent  size  of  cer- 
tain other  r.et  changes  In  means,  Intra  test  market  and  intra  control 
market  variance  was  also  large,  thus  reducing  the  significance  of  the 
net  changes.  The  only  statistically  significant  results  obtained 
were  those  concerning  the  awareness  of  radio  advertising.  (See  the 
Treatment  effects  row  In  the  table  on  Page  73.)  Moreover,  none  of 
the  service  by  treatment  Interactions  Is  significant  (same  table), 
suggesting  that  the  patterns  of  response  were  basically  similar  from 
service  to  service. 

Nevertheless,  for  reasons  outlined  earlier,  it  is  sometimes  Instruc- 
tive to  review  the  kinds  of  changes  that  occurred  during  the  test 
without  reference  to  statistical  significance.  These  can  provide 
additional  Insights  Into  the  nature  of  the  underlying  processes  at 
work.  The  primary  purpose  of  this  section  Is  to  provide  such  a 
summary. 

a.  Accessions 

Accessions  were  larger  during  the  test  period  than  during 
the  base  period  In  both  the  test  and  control  markets  (see 
Page  39).  However,  In  general,  the  test  markets  showed 
larger  Increases  than  control  markets.  Thus,  three  of  the 


four  services  showed  net  Increases  in  accessions  in 
radio  markets  during  the  test.  The  exception  was  the 
Navy  whose  test  market  and  control  market  performance 
is  virtually  Identical . 

Net  gains  in  radio  markets  were  largest  for  the  Army. 


POD  ACCESSION  INFORMATION1 2 3 
(Test  vs.  Control  Markets) 

2 

Base  Period  level  Change  From  Base  To  Test  Period 


Test 

Control 

Test 

Control 

Test  Change  - 

Markets 

Markets 

Markets 

Markets 

Control  Change 

+% 

+% 

3 

Total  000 

.082 

.078 

+ .070 

+ .063 

+ .007 

Air  Force 

.091 

.078 

+ .065 

+ .063 

+ .002 

Army 

.130 

.130 

+ .106 

+ .082 

+ .024 

Marines 

.039 

.047 

+ .031 

+ .029 

+ .002 

Navy 

.068 

.056 

+ .077 

+ .077 

Base  = August  1 to  September  6,  1975 
Test  = 9/7/75  to  12/28/75 

1.  Accessions  * High  School  Graduates,  Mental  Categories  I,  II,  and  III 
divided  by  QMA.  (Source:  General  Research  Corp.) 

2.  Table  Entries  = Average  accessions  per  market  per  month 

3.  DOD  * 4 service  average 
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b.  Inquiries 

Information  on  inquiries  was  gathered  from  two  sources. 
National  level  Inquiries  were  compiled  for  test  and 
control  markets  by  the  service  fulfillment  houses.  At 
the  same  time  lrcal  stations  were  audited  for  each  of 
the  four  services. 

In  general,  the  two  sources  show  similar  results.  Radio 
markets  tend  to  show  larger  rates  of  gain  than  the  con- 
trol markets.  This  holds  for  three  of  the  four  services 
for  the  fulfillment  house  statistics.  The  exception  this 
time  is  the  Marines,  where  control  markets  showed  larger 
gains  in  inquiries  than  radio  markets  (Page  41). 

Fulfillment  house  data  can  be  subdivided  into  mail  in- 
quiries and  phone  inquiries.  Mail  Inquiries  show  the 
same  pattern  as  total  inquiries.  Three  of  the  four 
services  showed  stronger  performance  in  test  markets. 

For  phone  Inquiries,  the  services  are  split.  The  Army 
and  Navy  show  superior  performance  In  test  markets,  the 
Air  Force  and  Marines  in  control  markets. 

Local  station  Inquiries  cover  slightly  different  Informa- 
tion, namely  walk-in  Inquiries,  inquiries  per  hour  audited 

* 

and  first  male  applicant  contacts.  All  of  the  series 
measured  point  in  the  direction  of  larger  gains  for  the 
radio  markets.  This  holds  true  for  all  four  services 
(Pages  42-45). 

♦Excludes  previous  contacts  and  Inquiries  of  friends  and 
relatives. 
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NATIONAL  INQUIRY  INFORMATION1 
(TEST  VS.  CONTROL  MARKETS) 


Base  Period  Level3 

Change  From  Base  To 

Test  Period 

Test 

Markets 

% 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Chanqe 

POD2 

25.8 

20.6 

+ 29.9 

+ 29.1 

+ -8 

Telephone 

2.7 

1.6 

+ 1.5 

+ 1.3 

+ .2 

Mall 

23.1 

19.0 

+ 28.4 

+ 27.8 

+ .6 

Air  Force 

12.1 

5.8 

+ 5.5 

+ 5.2 

+ .3 

Telephone 

5.4 

.8 

+ .9 

+ 1.4 

- .5 

Mall 

6.7 

5.0 

+ 4.6 

+ 3.8 

+ .8 

Army 

9.6 

6.8 

+ 29.7 

+ 18.4 

+ 11.3 

Telephone 

.9 

1.0 

+ .9 

- 

+ .9 

Mall 

8.7 

5.8 

+ 28.8 

+ 18.4 

+ 10.4 

Marine  Corps 

23.4 

22.8 

+ 31.1 

+ 44.3 

- 13.2 

Telephone 

.6 

.5 

+ 1.2 

+ 1.6 

.4 

Mall 

22.8 

22.3 

+ 29.9 

+ 42.7 

- 12.8 

Navy 

58.2 

47.0 

♦ 4.6 

Telephone 

4.1 

4.0 

+ 3.1 

+ 2.2 

+ .9 

Mall 

54.1 

43.0 

♦ 50.1 

+ 46.4 

+ 3.7 

Base  = August  1 to  September  6,  1975 

Test  * September  7,  1975  to  December  28,  1975 

1 - Source:  Fulfillment  Houses 

2 - DOD  a 4 Service  Average 

3 - Table  Entries  = Average  Number  of  Inquiries  Per  Market  Per  Month 


ARMED  FORCES  - AIR  FORCE 


TOTAL  STATION  INQUIRIES* 
(Test  vs.  Control  Markets) 


Base  Period  Level ^ 

Chanqe  From 

i Base  To 

Test  Period 

Test 

Control 

Test 

Control 

Test  Change  - 

Markets 

Markets 

Markets 

Markets 

Control  Chanqe 

INQUIRIES/ 

MARKET 

7.95 

5.52 

+0.99 

-0.16 

+1.15 

Telephone 

3.80 

2.63 

+0.74 

+0.04 

+ .70 

Walk-In 

4.15 

2.88 

+0.25 

-0.20 

+ .45 

First  Contact 

3.18 

1.93 

+1.15 

+0.36 

+ .79 

♦Source:  Recruiting  Station  Audit  Forms  (Male  Applicants) 
1 - Inquiries  * Average  Number  of  Inquiries  Per  Market 


Base  * August,  1975 
Test  * 9/7/75  to  12/28/75 


wr — — — - 
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ARMED  FORCES  - ARM* 

TOTAL  STAT ION  INQUIRIES* 
(Test  vs.  Control  Markets) 


1 

Base  Period  Level 

Change  Froir 

) Base  To 

Test  Period 

Test 

Control 

Test 

Control 

Test  Change  - 

INQUIRIES/ 

Markets 

Markets 

Markets 

Markets 

Contro'  Change 

MARKET 

12.82 

13.67 

*4.05 

-0.90 

+4.95 

Telephone 

7.53 

8.06 

*2.53 

-0.65 

+3.18 

Walk-In 

5.30 

5.61 

+ 1.52 

-0.24 

+1.76 

First  Contact 

5.59 

5.96 

+2.76 

+0.10 

+2.66 

♦Source:  Recruiting  Station  Audit  Forms  (Male  Applicants) 
1 - Inquiries  = Average  Number  of  Inquiries  Fer  Market 

Base  = August,  1975 
Test  * 9/7/75  to  12/28/75 
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ARMED  FORCES  - MARINES 

TOTAL  STATION  INQUIRIES* 
(Test  vs.  Control  Markets) 


Base  Period  Level ^ Change  From  Base  To  Test  Period 


INQUIRIES/ 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Chang 

MARKET 

2.09 

2.33 

+2.01 

-0.77 

+2.78 

Telephone 

.74 

1.27 

+0.86 

-0.30 

+1.16 

Walk-In 

1.35 

1.06 

+1.16 

-0.46 

+ 1.62 

First  Contact 

1.34 

1.49 

+1.02 

-0.46 

+1.48 

♦Source:  Recruiting  Station  Audit  Forms  (Male  Applicants) 
1 - Inquiries  * Average  Number  of  Inquiries  Per  Market 

Base  3 August,  1975 
Test  3 9/7/75  to  12/28/75 


w r ^ 

• 45. 


ARMED  FORCES  - 

NAVY 

TOTAL  STATION  INQUIRIES* 

(Test  vs.  Control 

Markets) 

Base  Period  Level1 

Change  From  Base  To 

Test  Period 

Test  Control 

Markets  Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Chanqe 

INQUIRIES/ 

MARKET 

9.01  10.69 

-1.05 

-3.59 

+2.54 

Telephone 

3.70  5.47 

+0.26 

-2.25 

+2.51 

Walk-in 

5.31  5.22 

-1.31 

-1.34 

+ .03 

First  Contact 

4.12  5.30 

-0.07 

-2.37 

+2.30 

♦Source:  Recruiting  Station  Audit  Forms  (Male  Applicants) 

1 - Inquiries  = Average  Number  of  Inquiries  Per  Market 

■ 

Base  a August,  1975 
Test  - 9/7/75  to  12/28/75 

1 ; J 

- — _ — -J 


c. 


^b. 

Recalled  Actions  (Response  to  Communications  Efforts) 

The  term  "recalled  actions"  refers  to  activities  such 
as  reading  direct  nail,  responding  to  mailings,  call- 
ing a toll  free  number,  or  sending  in  a coupon  --  any 
response  to  the  communications  efforts  of  the  services. 
These  statistics  were  generally  at  low  levels  and  their 
performance  during  the  test  was  somewhat  erratic 
(Pages  47-50). 

• The  criterion  of  reading  direct  mail  favors 
radio  markets  for  three  of  the  four  services. 
However,  for  the  Navy  control  markets  were 
slightly  better  than  radio  markets. 

• The  criteria  of  responding  to  mailings  and 
sending  in  coupons  show  superior  performance 
for  radio  markets  only  for  the  Marines.  For 
the  other  three  services,  net  changes  showed 
control  markets  ahead.  , 

• The  criterion  of  calling  toll  free  numbers  shows, 
first  of  all,  that  few  people  make  use  of  this 
medium  of  response.  For  those  who  did,  two 
services,  the  Army  and  the  Navy,  show  larger  net 
changes  in  radio  markets.  The  other  two  services 
show  larger  net  changes  in  control  markets. 

Memory  loss  may  also  account  for  some  of  the  lack  of 
reliability  for  the  measures  in  this  section. 


' 

, 
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ARMED  FORCES  - AIR  FORCE 

RESPONSE  TO  COMMUNICATIONS  EFFORTS* 
(Test  vs.  Control  Markets) 


Base  Period  Level ^ Change  From  Base  To  Test  Period 


Percentage... 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Change 

Read  direct  mall 

9.2 

5.9 

+0.5 

-0.8 

+1.3 

Respond  to  direct  mail 

1.1 

.2 

-0.5 

+0.2 

-0.7 

Call  800  number 

.5 

.0 

-0.3 

+0.6 

-0.9 

Return  ad  coupon 

.9 

.3 

+0.4 

+0.4 

+0.0 

♦Source:  Survey  Questionnaire  (time  period  is  "last  3 months") 

1 - Response  to  Communications  Efforts  = Average  Percent  Responding  Per  Market 


Base  ■ August,  1975 
Test  - 9/7/75  to  12/28/75 


ARMED  FORCES  - ARMY 


RESPONSE  TO  COMMUNICATIONS  EFFORTS* 


(Test  vs. 

Control 

Markets) 

Base  Period  Level 

Change  From  Base  To 

Test  Period 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Change 

Percentage... 

Read  direct  mall 

14.4 

16.6 

-1.1 

-1.5 

+0.4 

Respond  to  direct  mail 

1.6 

.8 

-0.8 

+0.0 

-0.8 

Call  800  number 

.1 

.0 

+0.1 

+0.0 

+0.1 

Return  ad  coupon 

1.1 

1.5 

-0.3 

-0.2 

-0.1 

♦Source:  Survey  Questionnaire  (time  period  is  "last  3 months") 

1 - Response  to  Conmuni cat  ions  Efforts  = Average  Percent  Responding  Per  Market 


Base  3 August,  1975 
Test  3 9/7/75  to  12/28/75 
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ARMED  FORCES  - MARINES 

RESPONSE  TO  COMMUNICATIONS  EFFORTS* 
(Test  vs.  Control  Markets) 


Base  Period  Level 

Change  From  Base  To 

Test  Period 

Percentage... 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Chanqe 

Read  direct  mail 

8.4 

7.0 

+1.8 

+0.7 

+1.1 

Respond  to  direct  mail 

1.2 

1.0 

-0.1 

-0.4 

+0.3 

Call  800  number 

.0 

.0 

+0.2 

+0.3 

- 0.1 

Return  ad  coupon 

.7 

1.2 

+0.0 

-0.8 

+0.8 

♦Source:  Survey  Questionnaire  (time  period  is  "last  3 months") 

1 - Response  to  Comnuni cat ions  Efforts  = Average  Percent  Responding  Per  Market 

Base  * August,  197S 
Test  * 9/7/75  to  12/28/75 


ARMED  FORCES  - NAVY 


RESPONSE  TO  COMMUNICATIONS  EFFORTS* 
(Test  vs.  Control  Markets) 


Base  Period  Level 

Change  From  Base  To 

Test  Period 

Percentage... 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Change 

Read  direct  mall 

12.6 

10.2 

-0.9 

+0.2 

-1.1 

Respond  to  direct  mall 

1.5 

.7 

+0.5 

+0.8 

-0.3 

Call  800  number 

.4 

.0 

+0.1 

+0.0 

+0.1 

Return  ad  coupon 

1.7 

.5 

-1.0 

+1.9 

-2.9 

♦Source:  Survey  Questionnaire  (time  period  is  "last  3 months") 

1 - Response  to  Cownuni cat  ions  Efforts  - Average  Percent  Responding  Per  Market 


Base  * August,  1975 
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d . Likelihood  of  Joining 

A number  of  attitudinal  measures  were  built  into  the 
consumer  survey  in  an  attempt  to  measure  the  pre- 
disposition of  men  in  the  17-24  age  grouo  to  join 
a service.  These  included: 

• Unaided  mentions  of  a service  in  the  respondent's 
"plans  for  the  next  few  years." 

• A forced  choice  between  "some  possibility"  and 
"no  possibility"  of  spending  time  In  their  late 
teens  or  early  twenties  serving  in  any  of  the 
Armed  Forces. 

• A rating  scale  of  the  likelihood  of  spending  some 
time  serving  (very  likely,  fairly  likely,  not 
very  likely). 

• A four  point  rating  scale  for  each  specific  service 
on  how  likely  the  respondent  was  to  enter  that 
service.  Because  It  has  been  shown  that  the  way 

in  which  a scale  is  scored  can  sometimes  affect 
its  sensitivity  and  its  powers  of  discrimination, 
this  scale  was  scored  In  two  ways  - linearly  (3, 

2,  1,  0)  and  as  a log  or  power  function  (9,  4, 

1,0). 


52. 

Results  of  the  radio  test  showed  these  scales  to  be 
relatively  highly  Intercorrelated.  Moreover,  they 
all  indicated  slightly  higher  net  changes  for  the 
control  markets.  Each  of  the  services  showed  similar 
results  (Pages  53-56). 
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ARMED  FORCES  - AIR  FORCE 

LIKELIHOOD  OF  JOINING* 
(Test  vs.  Control  Markets) 


Percentage. . . 

Unaided  mention  of  service  In 
"plans  for  next  few  years" 


Base  Period  Level  Change  From  Base  To  Test  Period 

Test  Control  Test  Control  Test  Change  - 

Markets  Markets  Markets  Markets  Control  Change 


"Some  possibility"  will  serve 
in  armed  forces 


30.9  27.8 


"Very  or  fairly"  likely  will 
serve  In  armed  forces 


24.9  22.2 


Probability  of  serving1 
Linear  scale  probability  of 
serving  (3,  2,  1,  0) 


Log  scale  probability  of 
serving  (9,  4,  1,  0) 


1.65  1.52 


♦Source:  Survey  Questionnaire 
1 - Probability  of  Serving  = Mean  Scale  Values  Per  Market 

" Base  = August,  1975 

Test  « 9/7/75  to  12/28/75 


ARMED  FORCES  - ARMY 


LIKELIHOOD  OF  JOINING* 
(Test  vs.  Control  Markets) 


Base  Period  Level 

Change  From  Base 

To  Test  Period 

Percentage... 

Unaided  mention  of  service  in 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Change 

"plans  for  next  few  years" 

.3 

.0 

+ .4 

+ .6 

- .2 

"Some  possibility"  will  serve 

in  armed  forces 

19.7 

11.3 

-1.1 

+3.2 

-4.3 

"Very  or  fairly"  likely  will 

serve  In  armed  forces 

Probability  of  serving^ 

Linear  scale  probability  of 

16.6 

8.3 

-4.1 

+2.0 

-6.1 

serving  (3,  2,  1,  0) 

.44 

.24 

-.09 

+ .06 

-.15 

Log  scale  probability  of 

serving  (9,  4,  1,  0) 

1.02 

.51 

-.25 

+ .14 

-.39 

♦Source:  Survey  Questionnaire 
1 - Probability  of  Serving  * Mean  Scale  Values  Per  Market 

Base  = August,  1975 
Test  = 9/7/75  to  12/28/75 
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ARMED  FORCES  - MARINES 

LIKELIHOOD  OF  JOINING* 
(Test  vs.  Control  Markets) 


Base  Period  Level 

Change  From  Base 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Percentage... 

Unaided  mention  of  service  In 

"plans  for  next  few  years" 

.4 

.7 

- .2 

- .2 

"Some  possibility"  will  serve 

In  armed  forces 

16.5 

12.5 

- .6 

- .5 

"Very  or  fairly"  likely  will 

serve  in  armed  forces 

12.8 

9.6 

-1.6 

- .1 

Probability  of  servinq^ 

Linear  scale  probability  of 
serving  (3,  2,  1,  0) 

.36 

.28 

-.03 

-.01 

Log  scale  probability  of 

serving  (9,  4,  1,  0) 

.84 

.65 

00 

o 

• 

1 

-.03 

•Source:  Survey  Questionnaire 
1 - Probability  of  Serving  = Mean  Scale  Values  Per  Market 


To  Test  Period 

Test  Change  - 
Control  Change 

- .1 

-1.5 

-.02 

-.05 


Base  = August,  1975 
Test  = 9/7/75  to  12/28/75 
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ARMED  FORCES  - NAVY 

LIKELIHOOD  OF  JOINING* 
(Test  vs.  Control  Markets) 


Base  Period  Level 

Change  From  Base  To  Test  Period 

Percentage... 

Unaided  mention  of  service  in 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Change 

"plans  for  next  few  years" 

.4 

.6 

+ .1 

+ .4 

- .3 

"Some  possibility"  will  serve 

in  armed  forces 

27.3 

22.5 

-5.8 

-3.4 

-2.4 

"Very  or  fairly"  likely  will 

serve  in  armed  forces 

Probability  of  serving^ 

Linear  scale  probability  of 

22.8 

17.2 

-5.1 

-2.5 

-2.6 

serving  (3,  2,  1,  0) 

.58 

.47 

-.11 

-.07 

-.04 

Log  scale  probability  of 

serving  (9,  4,  1,  0) 

1.32 

1.04 

-.22 

-.13 

-.09 

♦Source:  Survey  Questionnaire 

1 - Probability  of  Serving  = Mean  Scale  Values  Per  Market 

Base  = August,  1975 
Test  3 9/7/75  to  12/28/75 
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e.  Rating  of  Enlistment  Idea 

Respondents  were  also  asked  to  rate,  on  an  Excellent 
to  Poor  scale,  the  idea  of  enlisting  in  each  specific 
service  "for  the  average  young  man  of  your  age."  It 
is  correlated  with  the  measures  of  the  preceding 
section.  It  is  reported  separately,  however,  because 
it  seems  to  be  performing  somewhat  differently. 

For  every  service  without  exception,  the  radio  markets 
outperform  the  control  markets,  though  not  at  a sta- 
tistically significant  level.  While  the  real  reasons 
for  the  difference  in  the  behavior  of  this  measure  are 
not  certain,  it  can  be  hypothesized  that  the  radio 
communications  efforts  of  the  services  have  begun  to 
have  a positive  effect  on  the  "objective"  attitude 
toward  the  general  idea  of  joining  a service  but  have 
not  yet  been  personalized  to  the  extent  that  the 
respondent  sees  himself  as  a good  candidate  for  join- 
ing (Pages  58-61  ). 
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ARMED  FORCES  - AIR  FORCE 

RATING  OF  ENLISTMENT  IDEA* 
(Test  vs.  Control  Markets) 


6 

Base  Period  Level 

Change  From  base  To  Test  Period 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Chanoe 

Average  "Enlistment 
Idea  Rating" 

2.58 

2.65 

+.04 

-.07 

+.11 

♦Source:  Survey  Questionnaire  (Average  rating  on  a four-point  scale  -- 
"Excellent"  (4);  "Good"  (3);  "Fair"  (2);  "Poor"  (1)  - for  the 
average  young  man  of  your  age). 


Base  = August,  1975 
Test  = 9/7/75  to  12/28/75 


ARMED  FORCES  - ARMY 


RATING  OF  ENLISTMENT  IDEA* 
(Test  vs.  Control  Markets} 


Base  Period  Level 

Change  From  Base  To  Test  Period 

Average  "Enlistment 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control  Test  Change  - 
Markets  Control  Chanqe 

Idea  Rating" 

2.08 

2.11 

+.15 

+.02  +.13 

♦Source:  Survey  Questionnaire  (Average  rating  on  a four-point  scale  -- 
"Excellent"  (4);  "Good"  (3);  "Fair"  (2);  "Poor"  (1)  — for  the 
average  young  man  of  your  age). 

Base  = August,  1975 
Test  = 9/7/75  to  12/28/75 
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ARMED  FORCES  - MARINES 

RATING  OF  ENLISTMENT  IDEA* 
(Test  vs.  Control  Markets) 


Base  Period  Level 

Change  From  Base  To  Test  Period 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control  Test  Change  - 
Markets  Control  Change 

Average  "Enlistment 

Idea  Rating" 

2.18 

2.12 

+.01 

-.03 

+ .04 

♦Source:  Survey  Questionnaire  (Average  rating  on  a four-point  scale  -- 
"Excellent"  (4);  "Good"  (3);  "Fair"  (2);  "Poor"  (1)  — for  the 
average  young  man  of  your  age). 

Base  = August,  1975 
Test  = 9/7/75  to  12/28/75 


ARMED  FORCES  - NAVY 


RATING  OF  ENLISTMENT  IDEA* 
(Test  vs.  Control  Markets) 


Base  Period  Level  Change  From  Base  To  Test  Period 


Test  Control  Test  Control  Test  Change  - 

Markets  Markets  Markets  Markets  Control  Change 


Average  "Enlistment 

Idea  Rating"  2.46  2.48  +.07  -.03  +.10 


•Source:  Survey  Questionnaire  (Average  rating  on  a four-point  scale  -- 
"Excellent"  (4);  "Good"  (3);  "Fair"  (2);  "Poor"  (1)  — for  the 
average  young  man  of  your  age). 


Base  ■ August,  1975 
Test  = 9/7/75  to  12/28/75 
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f.  Advertising  Awareness 

The  awareness  statistics  reflect  favorably  on  the 
use  of  radio.  Both  awareness  of  service  advertising 
and  recall  of  radio  advertising  are  higher  in  radio 
markets  than  in  control  markets.  Once  again,  this 
situation  holds  true  for  each  of  the  four  services. 

Tables  on  levels  of  change  follow  (Pages  63-66). 
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ARMED  FORCES  - AIR  FORCE 

ADVERTISING  AWARENESS* 
(Test  vs.  Control  Markets) 


Base  Period  Level ^ ^ 

Chanqe  From  Base  To  Test  Period 

Test  Control 

Test  Control  Test  Change  - 

Percentage... 

Markets 

Markets 

Markets 

Markets 

Control  Change 

Seeing  or  hearing 

service  advertising 

42.2 

40.9 

+3.4 

- .2 

+3.6 

Recalling  radio 

advertising 

6.2 

8.8 

+6.6 

+ 1.8 

+4.8 

♦Source:  Survey  Questionnaire 

1)  Table  Entry  * Average  percent  per  market 


Base  3 August,  1975 
Test  3 9/7/75  to  12/28/75 
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Percentage... 


Seeing  or  hearing 
service  advertising 


Recalling  radio 
advertising 


ARMED  FORCES  - ARMY 


ADVERTISING  AWARENESS* 
(Test  vs.  Control  Markets) 


Base  Period  Level ^ ^ Change  From  Base  To  Test  Period 


Test  Control 
Markets  Markets 


Test  Control  Test  Change  - 
Markets  Markets  Control  Change 


47.1 


49.6 


+6.9 


-i.  5 


+8.4 


7.5 


5.8 


+17.1 


+5.9 


+ 11.2 


♦Source:  Survey  Questionnaire 

1)  Table  Entry  = Average  percent  per  market 


Base  = August,  1975 
Test  * 9/7/75  to  12/28/75 
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ARMED  FORCES  - MARINES 

ADVERTISING  AWARENESS* 
(Test  vs.  Control  Markets) 


1) 

Base  Period  Level  Change  From  Base  To  Test  Period 

Test  Control  Test  Control  Test  Change  - 

Markets  Markets  Markets  Markets  Control  Change 


Percentage... 


Seeing  or  hearing 

service  advertising  47.5  47.3  +1.7 

Recalling  radio 

advertising  7.0  9.9  +12.1 


♦Source:  Survey  Questionnaire 

1)  Table  Entry  = Average  percent  per  market 


-1.5 


-2.8 


+3.2 

+ 14.9 
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ARMED  FORCES  - NAVY 

ADVERTISING  AWARENESS* 

(Test  vs.  Control  Markets) 

Base  Period  Level1  ^ Change  From  Base  To  Test  Period 

Test  Control  Test  Control  Test  Change  - 

Markets  Markets  Markets  Markets  Control  Change 


Percentage... 

Seeing  or  bearing 
service  advertising 

Recalling  radio 
advertising 


46.8 


7.4 


48.4 


11.0 


-1.2 


+5.3 


-3.3 


-3.9 


+2.1 


+9.2 


♦Source:  Survey  Questionnaire 

1)  Table  Entry  = Average  percent  per  market 

Base  » August,  1975 
Test  * 9/7/75  to  12/28/75 
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g . Advertising  Source  Reca 1 1 

In  the  consumer  survey,  respondents  were  asked,  for  each 
servic*  , not  only  whether  or  not  they  had  seen  or  heard  any 
adve  tising  in  the  past  month  but,  if  so,  in  what  medium 
they  had  seen  or  heard  it. 

While  net  advertising  source  recoil  advanced  in  general, 
there  is  some  evidence  of  confusion  as  to  the  precise  media 
source.  For  the  Army,  the  Marines,  and  the  Navy,  the  net 
changes  in  mentions  of  radio  are  generally  large  relative  to 
net  Increases  In  other  media.  For  the  Navy  and  the  Marines, 
the  net  increases  in  radio  are  larger  than  those  of  any  other 
medium.  For  the  Army  they  are  very  large  (+10.8  percentage 
points)  and  second  to  television  changes.  For  the  Air  Force, 
the  radio  net  changes  are  third  behind  the  net  changes  for 
billboards  and  magazines. 

Perhaps  the  most  likely  reason  for  these  results  is  that 
people  are  notoriously  poor  at  remembering  the  sources  of 
the  messages  they  received.  It  Is  common  for  people  to 
remember  having  been  exposed  to  advertising  but  not  to  be 
able  to  remember  the  exact  source  of  their  exposure. 
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RECALL  OF  ADVERTISING  FOR  THE  AIR  FORCE 


68. 


Base  Period*^ 
test  Control 
Markets  Markets 


Test  Period 
Test  Control 
Markets  Markets 


Test  Change  - 
Control  Change 


Recalled  Media  Source 


Television 


23.1 


24.3 


25.0 


19.4 


+6.8 


Radio 

6.2 

8.8 

12.8 

10.6 

+4.8 

Billboards 

26.4 

30.6 

28.2 

29.4 

+3.0 

Newspapers 

6.4 

9.2 

8.3 

9.6 

+ 1.5 

Magazines 

21.6 

25.4 

26.4 

24.3 

+5.9 

Mailings  to  respondent's 

home 

12.4 

12.3 

11.1 

10.1 

+ .9 

1)  Percentages  * fractions  of  total  test  markets  survey  sample  and  total  control 
markets  survey  sample  recalling  advertising  source 

Base  a August,  1975 
Test  = 9/7/75  to  12/28/75 
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RECALL  OF  ADVERTISING  FOR  THE  ARMY 


Recalled  Media  Source 

Base  Period1 ^ 
Test  Control 
Markets  Markets 

* * 

Test 

Test 

Markets 

% 

Period 

Control 

Markets 

% 

Test  Change  - 
Control  Change 

Television 

20.8 

27.2 

28.1 

22.3 

+ 12.2 

Radio 

7.5 

5.8 

24.2 

11.7 

+ 10.8 

Billboards 

31.7 

32.0 

32.2 

33.0 

- .5 

Newspapers 

13.8 

14.3 

11.4 

12.3 

- .4 

Magazines 

Mailings  to  respondent's 

29.6 

32.1 

31.9 

28.7 

+ 5.7 

home 

17.7 

21.6 

17.1 

17.1 

+ 3.9 

1)  Percentages  = fractions  of  total  test  markets  survey  sample  and  total  control 
markets  survey  sample  recalling  advertising  source 

Base  2 August,  1975 
Test  2 9/7/75  to  12/28/75 
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RECALL  OF  ADVERTISING  FOR  THE  MARINE  CORPS 


Base  Period*^ 

Test 

Period 

Test 

Markets 

Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Change 

% 

% 

t 

% 

Recalled  Media  Source 

Television 

25.5 

22.8 

25.0 

23.5 

- 1.2 

Radio 

7.0 

9.9 

19.0 

7.0 

+ 14.9 

Billboards 

1 

32.0 

34.9 

32.8 

31.3 

+ 4.4 

Newspapers 

6.4 

12.1 

8.4 

8.3 

+ 5.8 

Magazines 

21.4 

29.8 

, 27.6 

24.3 

+11.7 

Mailings  to  respondent's 

home 

15.1 

15.9 

13.3 

15.0 

- .9 

1)  Percentages  = fractions  of  total  test  markets  survey  sample  and  total 
markets  survey  sample  recalling  advertising  source 

control 

Base  3 August,  1975 

Test  3 9/7/75  to  12/28/75 

RECALL  OF  ADVERTISING  FOR  THE  NAVY 


Base  Period*^  Test  Period 


Test 

Markets 

I 

Recalled  Media  Source 


Television  21.4 

Radio  7.4 

Billboards  29.8 

I 

Newspapers  5.5 

Magazines  24.5 


Mailings  to  respondent's 
home  13.2 


Control 

Markets 

Test 

Markets 

Control 

Markets 

Test  Change  - 
Control  Chanqe 

% 

% 

% 

24.6 

23.5 

21.2 

+ 5.5 

11.0 

12.7 

7.2 

+9.1 

37.6 

31.2 

36.4 

+2.6 

7.0 

9.0 

8.8 

+1.7 

30.7 

28.1 

27.3 

+7.0 

18.4 

13.7 

15.2 

+3.7 

1)  Percentages  ■ fractions  of  total  test  markets  survey  sample  and  total  control 
markets  survey  sample  recalling  advertising  source 


Base 1 *  3 August,  1975 

Test  3 9/7/75  to  12/28/75 
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0.  Statistical  Analyses 


While  it  is  virtually  impossible  to  fully  analyze  a data  bank 
of  the  size  gathered  In  the  course  of  this  study  (because  the 
analytical  possibilities  are  almost  limitless),  especially  in 
the  time  that  has  elapsed  since  the  completion  of  the  test, 
nevertheless  a good  many  statistical  analyses  were  carried  out 
in  the  course  of  thi»  research.  The  purpose  of  this  section 
is  to  provide  a succinct  summary  of  what  was  done  and  of  the 
results  of  these  analyses. 


The  overall  rationale  behind  these  analyses  was  as  follows: 

Step  1.  Factor  Analysis 

Twenty-one  criteria  is  too  large  a set  to  be  manageable. 
Factor  analysis  can  be  used  as  an  aid  in  selecting  a 
smaller  number  of  criterion  measures  which  are,  taken 
together,  representative  of  the  larger  set  and  each  of 
which  is  relatively  independent  of  the  others.  To 
permit  comparisons  across  services  these  should  be 
the  same  for  every  service. 

Step  2.  Co-Variate  Selection 

Once  the  key  criteria  have  been  determined  in 
Step  1 the  co-variates  most  likely  to  affect  the 
analysis  need  to  be  identified.  Again,  this  must 
, be  a comparatively  small  number  because  of 
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limitations  on  the  number  of  degrees  of  freedom. 
Correlation  between  each  of  the  key  criteria  and 
the  co-variates  can  be  helpful  in  the  selection 
process. 

Step  3.  Covariance  Analysis 

The  effects  of  potentially  distorting  variables 
need  to  be  taken  into  consideration.  Parallel 
analyses  across  services  and  across  key  criterion 
measures  are  desirable  to  permit  comparisons  to 
be  made. 


1 . Factor  Analysis  of  Criterion  Measures 

Twenty-one  potential  criterion  measures  were  obtained  in 
the  course  of  the  study.  However,  many  of  them  represented 
different  ways  of  measuring  the  same  underlying  variable. 

To  eliminate  redundancy  and,  at  the  same  time,  reduce  the 
number  of  subsequent  analyses  to  more  manageable  dimensions, 
a factor  analysis  was  run  for  each  service  separately,  using 
the  SPSS  program.  Similar  but  overlapping  factor  structures 
were  found.  Consequently,  it  was  decided  that  marker 
variables  rather  than  factor  stores  would  be  used  in  subse- 
quent analyses.  The  factor  structures  were  compared  from 
this  point  of  view. 
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Based  on  the  results  of  the  comparisons,  plus  an  examin- 
ation of  the  correlation  matrix  produced  as  an  intermed- 
iate part  of  the  output.  It  was  decided  that  the  criterion 
measures  could  safely  be  reduced  to  four  which  are  relatively 
Ir.dependent  of  each  other  and  adequately  represented  all 
twenty-one  originally  selected  criteria. 

• Accessions  (as  represented  by  DOD  accessions 
data) 

• Inquiries  (as  represented  by  the  audit  of  total 
local  inquiries) 

• Attitudes  (as  represented  by  the  log  probability 
scale) 

• Awareness  of  radio  advertising  (as  represented 
by  the  survey  responses) 

Selection  of  Co-Variates 


Because  the  number  of  available  co-variates  was  far  too 
large  for  the  number  of  degrees  of  freedom  available  from 
the  experimental  design  it  became  necessary  to  screen  them 
down  to  a more  reasonable  size.  Accordingly,  changes  In 
each  of  the  4 key  factor  criteria  were  correlated  with  each 
of  the  co-variates  using  the  SPSS  Pearsonlan  correlation 
routine  of  the  University  of  Pittsburg.  This  analysis 
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was  done  four  times,  once  for  each  service.  Five  covariates  were 
then  chosen  on  the  grounds  that  they  were  most  strongly  related 
to  the  criterion  measures,  that  the  relationships  found  appeared 
to  hold  for  all  or  almost  all  of  the  services,  and  that  they 
appeared  to  have  high  levels  of  generality  across  criteria  and  to 
be  logically  disparate.  These  were: 

• Number  of  stations/QMA 

• Percent  with  high  school  military  training 

• Percent  unemployed,  looking,  past  two  years 

• Percent  with  father,  relative,  or  friend  in  the 
service 

• Percent  listening  regularly  to  any  radio  type 

Changes  in  two  of  the  four  criteria  (inquiries  and  attitudes)  were 
found  not  to  be  significantly  correlated  with  any  of  the  candidates 
for  co-variate  status. 


Analysis  of  Variance  and  Co-Variance 

This  section  reviews  the  tests  of  statistical  significance  that  were 
conducted  to  evaluate  radio  performance  and  to  adjust  for  the  effects 
of  the  selected  covariates.  The  overall  analysis  of  variance  com- 
pared results  for  each  service  under  three  experimental  treatments  -- 
for  the  non-broadcast  situations,  for  the  situation  in  which  the 
service  was  the  only  radio  advertiser  and  for  the  situation  where  the 

service  used  radio  advertising  along  with  two  other  services. 

I • 
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The  first  conclusion  from  this  analysis  was  that  the  effects  of  the  selected 
covariates  generally  were  not  significant,  the  exception  being  high  school 
military  training  (F  * 5.83)  which  inexplicably  appears  to  have  a slight 
negative  effect  on  awareness.  Because  the  adjustment  effect  was  minimal, 
data  shown  In  every  section  other  than  this  one  are  unadjusted  for  covariate 
effects . 

F tables  for  each  of  the  four  criteria  follow: 

ANALYSIS  OF  VARIANCE1  AND  CO-VARIANCE 


Sumnary  of  F Ratios 


DF 

Accessions 

Inquired 

Attitudes 

Awareness 

Total 

48 

Total  Reduction 

17 

3.34 

3.88 

.60 

9.31 

Grand  Mean 

1 

1.25 

25.73 

.97 

46.18 

Experimental  Treatment 
(Test  Vs.  Control) 

2 

1.47 

.62 

.73 

14.65* 

Service 

3 

2.94* 

.68 

.75 

3.86* 

Service  By  Treatment 
Interactions 

6 

.67 

.84 

.43 

1.61 

Co-Variates 

No.  of  Recruiting  Sta. 

1 

.73 

.17 

.09 

3.83 

High  School  Military 
Training 

1 

.00 

2.23 

.03 

5.83* 

Unemployment 

1 

.24 

.62 

.44 

.28 

Relatives;  Friends  In 
Armed  Services 

1 

.30 

.06 

.67 

.25 

Regular  Radio  Listener 

1 

.02 

.24 

.16 

.14 

Rema i nder 

31 

1 It  is  recognized  that  this  form  of  analysis  ignores  the  lack  of  indepen- 
dence stenining  from  multi -service  use  of  markets . However,  separate 
analysis  for  individual  services  generally  support  the  patterns  evident 
here. 

* F ratio  significant  at  .05  level 
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From  the  standpoint  of  the  objectives  of  the  test,  the  asterisk 
flagging  the  treatment  effects  on  awareness  (F  = 14.65)  is,  of  course, 
of  the  greatest  importance.  It  indicates  that  treatment  effects 
are  large  and  statistically  significant  for  the  awareness  of  radio 
advertising.  The  table  of  adjusted  means  presented  below  indicates 
also  that  awareness  changes  increased  sharply  when  more  than  one 
service  used  radio.  On  average,  awareness  changes  were  almost 
twice  as  high  (.115)  for  services  using  radio  along  with  other 
services  as  they  were  for  single  service  advertising  (.069).  Put 
another  way,  it  can  be  concluded  that  when  those  services  used 
radio,  the  level  of  awareness  for  any  given  service  was  higher  than 
it  would  have  been  had  that  service  been  the  only  one  using  radio. 


A closer  examination  of  the  table  entitled  Changes  in  Awareness  on 
the  following  page  shows  apparent  differences  between  patterns  of 
response  by  service  to  variations  In  treatment  conditions.  Despite 
the  fact  that  the  service  by  treatment  interaction  is  not  signifi- 
cant, these  may  be  of  some  Interest.  For  example,  the  Army  experi- 
enced large  gains  in  awareness  whether  it  alone  was  using  radio  or 
whether  the  other  services  were  also  using  it.  The  Navy  shows  a 
similar  pattern. 


The  Marines  are  not  far  different  from  the  overall  pattern  of 
response.  However,  the  Air  Force  did  best  when  it  was  not  the  only 
service  employing  radio. 
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CHANGES  IN  AWARENESS 

I 

(Adjusted  For  Covariates) 

( Air  Average 

Force  Army  Marines  Navy  Change 

Treatment 

Using  radio  with  other 


services 

.087 

.182 

.135 

.055 

.115 

Using  radio  alone 

.001 

.189 

.042 

.045 

.069 

Not  using  radio 

.022 

.068 

-.049 

-.037 

.001 

Overall  average  by  service 

.037 

.146 

.043 

.021 

.062 

A similar  table  of  adjusted  means  Is  included  for  accessions.  It 
should  be  cautioned  here,  however,  that  unlike  awareness  of  radio 
advertising,  treatment  effects  for  accessions  are  not  statistically 
significant.  A look  at  the  table  shows  why.  As  reported  earlier 
(See  Chart  3,  P.16),  Navy  showed  a slightly  lower  rate  of  change  In 
accessions  in  radio  markets  than  It  did  in  control  markets.  This 
traces  to  a slightly  lower  change  (.026)  in  markets  in  which  it 
used  radio  with  other  services  than  in  control  markets  (.028) 


Each  of  the  other  three  services  showed  higher  rates  of  change  in 
markets  using  radio  than  in  those  not  using  it.  This  held  true 
both  for  single  service  markets  and  for  those  in  which  several 
services  were  using  radio  simultaneously. 


CHANGES  IN  ACCESSIONS* 
(Adjusted  For  Covariates) 


Treatment 

Air  Force 

Army 

Marines 

Navy 

Using  'adlo  with  other 
services 

.018 

.033 

.016 

.026 

Using  radio  alone 

.019 

.032 

.012 

.031 

Not  using  radio 

.013 

.020 

.011 

.028 

Overall  average  by  service 

.017 

.029 

.013 

.028 

* Accessions  of  high  school  graduates,  mental  categories  I,  II  and 
III  divided  by  QMA 


Asterisks  on  the  Summary  Table  of  F Ratios  designating  significant 
differences  also  appear  In  the  "Service"  row  next  to  accessions 
(F  = 2.94)  and  awareness  (F  = 3.86).  These,  however,  do  not  In- 
volve the  radio  variable.  Rather,  the  accessions  result  indicates 
that  changes  In  accessions  for  the  Army  and  the  Navy  were  larger 
during  the  test  period  than  they  were  for  the  other  two  services, 
both  among  control  markets  and  test  markets  (see  the  column  totals 
In  the  table  on  changes  In  accessions  above).  Similarly,  the 
awareness  result  traces  back  to  the  fact  that  changes  in  awareness 
for  the  Army  were  larger  than  those  for  the  other  threA  services 
(see  the  column  totals  In  the  table  on  changes  on  awareness  of 
radio  advertising,  P.73)  both  among  control  markets  and  test  markets. 
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First  Half/Second  Half  Comparisons 

As  mentioned  earlier,  the  results  of  the  experiment  showed  a high 
degree  rf  Internal  consistency.  The  following  table  of  changes  in 
criterion  measures  Illustrates  this  fact.  Only  the  signs  that  are 
circled  changed  direction  between  the  first  half  results  and  the  con- 
clusion of  the  test.  For  example,  at  the  midpoint  In  the  test  the 
local  Inquiry  audits  of  phone  Inquiries  for  the  Air  Force  showed  a 
slightly  superior  net  performance  for  non-broadcast  markets  and 
therefore  carried  a sign.  However,  final  results  favored  radio 
markets  and  thus  are  labeled  with  a "+".  The  "+"  has  been  circled 
to  denote  the  change  In  sign. 


Note  that  almost  all  of  the  changes  are  In  the  direction  of  improved 
consistency.  Only  the  Marine  Corps  figures  for  the  total  of  recalled 
mall,  toll  free,  and  coupon  inquiries  shows  a change  to  a direction 
that  is  less  compatible  with  the  directions  of  change  In  the  other 
services. 


4 ** 

5.  Equivalencies 

The  necessity  of  adding  matching  print  to  control  markets  In 
many  cases  (to  balance  the  radio  additions)  raised  the  Issue 
of  whether  any  lack  of  observed  changes  traceable  to  the  use 
of  radio  might  be  the  fault  of  the  levels  at  which  the  tests 
were  bilng  conducted.  In  other  words,  was  the  test  being 
run  at  or  close  to  saturation  levels?  If  so,  any  lack  of 
observed  effects  might  be  attributable  to  the  level  of  the 
test  rather  than  to  the  effects  of  differing  media  mixes. 

To  test  this  possibility,  the  magnitudes  of  the  changes  obtained 
In  the  behavioral  criteria  accessions  and  Inquiries  were  related 
to  the  per  capita  (per  QMA)  total  media  spending  levels  In  Indi- 
vidual markets.  If  the  largest  gains  were  obtained  In  markets 
with  relatively  low  spending  rates,  there  would  be  reason  to 
further  consider  this  possibility. 

■ * 

Results  showed  no  clear  pattern  of  relationship,  suggesting 
that.  In  general,  the  levels  of  the  test  were  not  so  high  as 
to  cause  consistent  "celling  effects."  The  negative  relation- 
ships that  might  signal  a potential  problem  appear  In  only 


five  of  eight  comparisons  Involving  the  two  key  behavioral 
measures  — accessions  and  Inquiries  (See  Page  78).  Moreover, 
the  highest  single  correlation  coefficient  Is  positive.  Also 
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First  Half  vs. 

Second  Half  Test  Measures 

(Directional  Changes) 

AIR 

Criterion  Variables  DOO  FORCE 

ARMY 

MARINE 

CORPS 

NAVY 

♦Accessions 

+ 

+ 

+ 

+ 

- 

National  Inquiries  - 

Total 

+ 

+ 

+ 

- 

♦ 

Phone 

+ 

_ 

+ 

_ 

+ 

Mall 

+ 

+ 

+ 

- 

+ 

Local  Inquiry  Audits  - 

♦Total 

+ 

+ 

♦ 

+ 

+ 

Phone 

+ 

♦ 

4 

♦ 

Walk-In 

+ 

+ 

4 

First  male  app. 

+ 

+ 

+ 

♦ 

Recalled  Actions  - 

0 

0 

Read  direct  mall 

0 

4 

- 

Responded  to  mailing 

♦ 

- 

Called  toll  free  no. 

- 

- 

+ 

- 

♦ 

Sent  In  coupon 

- 

- 

- 

4 

- 

Mall  + toll  free  + coupon 

- 

- 

- 

0 

- 

Attltudes-In  Plans  For  Next 

o 

Few  Years 

- 

- 

- 

- 

Some  possibility  of  joining 

- 

- 

- 

- 

Very/falrly  likely  to  join 

- 

0 

- 

- 

- 

Probability  (linear) 

- 

© 

- 

- 

- 

♦Probability  (log) 

- 

0 

- 

- 

- 

Idea  Of  Enlistment 

+ 

+ 

+ 

© 

♦ 

Awareness  Of  Advertising 

+ 

+ 

4 

♦ 

+ 

♦Awareness  Of  Radio  Advertising 

+ 

+ 

4 

+ 

+ 

♦ ■ favors  radio  markets 
- * favors  non-broadcast  markets 

♦Variables  tested  for  significance 

O Sign  reversed  by  second  half  test  results 
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the  largest  negative  relationship  occurs  for  the  Air  Force,  a 
service  that  Is  spending  at  lower  per  capita  rates  than  some 
other  services.  The  Army,  with  the  highest  spending  rates, 
shows  no  signs  of  suffering  from  It.  Its  performance  on 
criterion  measures  Is  at  least  the  equal  of  the  other  services. 

Correlations  with  i/QHA 

Army  Marines  Havy 

-.04  -.17  .72 

-.54  .26  .82 


Air  Force 

Accessions  -.47 

Inquiries  -.78 


A 


